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Abstract. Motivated by Carleman's proof of isopcrimctric inequality in the 
plane, we study some sharp integral inequalities for harmonic functions on the 
upper halfspace. We also derive the regularity for nonnegative solutions of the 
associated integral system and some Liouville type theorems. 



1. Introduction 

The classical isoperimetric inequality in the plane states that for any bounded 
domain with area A and boundary length L we have 
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(1.1) AnA<L 

and equality holds if and only if the domain is a disk. Inequality (|1.1[) remains true 
for bounded domains in a simply connected surface with nonpositive curvature. 
Among the proofs of this fact the one due to Carleman [C] is particularly interesting. 
Indeed, let (M 2 ,g) be any simply connected compact surface with boundary and 
nonpositive curvature, it follows from Riemann mapping theorem that (M 2 ,g) is 
isometric to {^b\, e 2m gg^J , here B\ is the two dimensional open unit disk and gs,2 

is the Euclidean metric on R 2 . The nonpositivity of curvature implies that w is 
a subharmonic function. Let u be the harmonic function on B\ with the same 
boundary value as w, then w < u. In C it was proved that for any smooth 

2 

harmonic function on B l we have 

(1.2) j^<l-[j st e-m 

and equality holds if and only if u (x) = c or — 2 log \x — xo\ + c for some xq G R 2 \£>i 
and constant c. We may ask for natural generalizations to higher dimensions. 
Without an analog of the Riemann mapping theorem, we may start with a metric 
g = p"- 2 <?r» on B 1 with nonpositive scalar curvature, here n > 3, B™ is the open 
unit ball in M. n and <7rh is the Euclidean metric on R™. It follows that p is a 
subharmonic function. Under the metric g the volume of B\ is equal to J B p™- 2 dx 

2(re-l) 

and the area of dB\ is equal to J gB p »- 2 dS. We would like to know whether the 
inequality 

2n n 1 ( f 2(rc-l) 

p~dx < n~~Lu n / p ™- 2 dS 

Bi KJdB! 

is still true. Here uj n is the Euclidean volume of the unit ball in R™. Since p is 
bounded from above by the harmonic function with the same boundary value, we 
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only need to know whether the inequality 

(1.3) M Jin <n~^^y(Jn^ =Ty HI 2(„-l) 

is true for every smooth harmonic function u on B 1 . The answer to this question 
is affirmative and the inequality may be proved by subcritical approximation (see 
HWY ). However, for future purpose it seems helpful to transfer this problem 
to upper halfspace and derive some Liouville type results. Indeed, assume u is 
a positive harmonic function on B±, let e„ = (0, • • • ,0, 1) and <f> be the Mobius 
transformation given by 

x + 

<H T ) = , T72 ~ e «- 

\x+ e -f\ 

Then <j> (K«) = B 1 and 



1 - 

-j cfccj <g> dx 4 



i=l 



Here R% = {x € R™ : x n > 0}. Let 

1 



v (x) 



then <p* [u™- 2 g^n \ = w-2g R „. The inequality (|1.3p becomes 





e in-2" 




e„ 1 






v |x H 


2 1 



-2 — 7 



(1.4) K-*W n M ^n" 5 ^^^ 17 ^ 2^ • 

Note that since u is the Poission integral of uL„_i, inequality p.4|) follows from 
Theorem ll.ll below. To state the results, let us fix some notations. For convenience, 
we use x, y, ■ ■ ■ for points in R n and £, £, • • • for points in R™ _1 = {a; G R™ : x„ = 0}. 
For x € R™, we let x' = (xi, • • • , x„_i), x = (x',x n ). The Poission kernel for the 
upper half space is given by (see [Sj p61]) 

P(x,Z) = —- X - forxeR^eR"- 1 . 

[\x'-Q +x 2 n j 

Given a function / defined on R n_1 , let 

(P/)(x)= / P(x,0/(0^ forxeR^. 



We have the following sharp inequality for P (see Theorem 14. lft : 
Theorem 1.1. Assume n > 3, then for any 

(1.5) |P/| - < n-^T^T 5 ^ |/| ^ 

^"" 2 ( R +) L n-2 (Rn-1) 

Moreover, equality holds if and only if f (£) = 5=3- /or some constant c, 

(A 2 + |«-?o| 2 )^- 

positive constant X and £0 G R™ _1 . 
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If we look at the variational problem 

(1.6) c„ = sup(|P/| ^ :/ei^ i (R"- 1 ),|/| ^ =1 
Then any nonnegative critical function /, after scaling must satisfy 

(1.7) f(t)^=f P(x,0(Pf)(x)^dx. 



We have the following Liouville type theorem (see Proposition ^. ip which is in the 
same spirit as those in [GNNl ICUSl ICLOl IE] . 



Theorem 1.2. Assume n > 3, / G L ;o ™ 2 (R" x ) is nonnegative, not identically 
zero and it satisfies then for some A > and £o S R n , 



/(£) = c(n) 7 

U 2 + ie-&i 2 , 



- 



We note that the condition / g L t " c ~ 2 (R n_1 ) can not be dropped since c (n) 
is a singular solution for (JT7TJ) . During the process of identifying maximizing func- 
tions in Theorem 11.11 and the critical functions in Theorem 11.21 we establish the 
following interesting fact (see Proposition 14. 1|) : 

Proposition 1.1. Let n > 2, u be a function on R n which is radial with respect 
to the origin, < u{x) < oo for x ^ 0, e\ = (1, 0, • • • , 0), a € R, a ^ 0. // 

v (x) — \x\ a u (yj^i — e i) * s radial with respect to some point, then either u(x) — 
( ci + C2 ) for some c\ > 0, C2 > or 



u (x) 



ci \x\ a , ifx^O, 
c 2 , ifx = 0, 



for some c\ > and C2, an arbitrary number. 

There are similar statements for the cases a — or n — 1 (see Remark 14.11 
and Proposition 14. 2| . The crucial point of Proposition 11.11 is that we do not need 
any regularity assumption on the function u. This is very convenient when the 
regularity of extremal functions are hard to get apriorly. The radial symmetry 
property of function may come from symmetrization arguments or the method of 
moving planes etc. For example, Proposition 11.11 gives another way to determine 
the maximizing functions for those cases of Hardy-Littlewood-Sobolev inequalities 
studied in |Li2[ section III] . The formulation of Proposition 11.11 is motivated from 
previous works in [CL,[0], |CLQ2[ section 3] and |CLQ3[ section 6]. It is worth 
pointing out that Proposition 11.11 is the fact for method of moving planes which 
corresponds to the fact \LZ\ lemma 2.5] or jL] lemma 5.8] for the method of moving 
spheres, a variant of the method of moving planes. 

According to Proposition 12. II below, for n > 2 and 1 < p < oo the operator 

P : L p (R"- 1 ) -> L^r (R™) : f^Pf 
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is always a bounded linear map. From the analytical point view it is interesting to 
consider the variational problem 

(1.8) Cn, p = sup ||P/| l ^ k) (R- 1 ) , \f\ LP(M ^ = 1 

for all such p's. Fix 1 < p < oo, for a function / defined on R™ -1 , A > and 
C G R n_1 , we write 

(£) = \-^f for £ G R"" 1 . 



A 

Then we have (see Theorem 13.11 and Theorem 14. ip : 

Theorem 1.3. Given n > 2 and 1 < p < oo. 

• Let fi be a maximizing sequence of functions for \1.8\) , then after passing 
to a subsequence there exists A; > and Q £ R n_1 such that f^"''' — ^ f in 
L p (R" -1 ). In particular, there exists at least one maximizing function. 

• After multiplying by a nonzero constant, every maximizer f of il.8\) is 
nonnegative, radial symmetric with respect to some point, strictly decreasing 
in the radial direction and it satisfies 



(1.9) f(0 P = P(x,0(Pf)(x)^-'dx. 

• If n > 3 and p — 2 ^"Jq^ , then any maximizer of il.8\) must be of the form 

f(0 = ±c(n) 



A 2 + l^-^ol 2 . 



for some A > 0, £o G R" . In particular c 2(n-i) = n 2 ( n -^uj n 2 ™ ( " 1) . 

n ' n — 2 

• If n>3 and p — 2 ^" n 1 - ) , then any maximizer of U.8\ ) must be of the form 

/ \ n/2 

f(0=±c(n) 



,A 2 + |£-£o| 
for some A > 0, £o G R n— . In particular 




C 2(„-l) = 
n, — — - — - 

It is interesting that the problem considered here demonstrates very similar struc- 
tures to the sharp Hardy-Littlewood-Sobolev inequalities studied in [Li2j . Besides 
above properties of maximizing functions, we know they are smooth. This is a non- 
trivial fact since it does not follow from the usual bootstrap method. Indeed, we 
know all the nonnegative critical functions of (|1.8|) are smooth and radial symmetric 
with respect to some point (see Theorem 15.11 and Theorem 16. ip . More precisely we 
have 

Theorem 1.4. Given n > 2 and 1 < p < oo. If f E L p (R n_1 ) is nonnegative, 
not identically zero and it satisfies U.9\) . then f £ C°° (R™ -1 ), moreover it is 
radial symmetric with respect to some point and strictly decreasing along the radial 
direction. 
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In Section [2] below, we will collect some basic estimates for Poission integrals and 
show the operator P is bounded in suitable Lebesgue spaces and Lorentz spaces. 
In Section [31 we apply the general frame of concentration compactness principle 
( [Lionj ) to show that every maximizing sequence of (|1.8p . after scaling and trans- 
lation, must converge strongly. In Section [4j following Lieb we use the method of 
symmetrization based on the Riesz rearrangement inequalities ( |LiL[ section 3.7]) 
and its strong form ( |Lilj ) to show that all maximizing functions must be radial and 
give another approach to the existence of maximizing functions. In Section[5]we use 
the method in |Hn| to deduce the regularity of all nonnegative critical functions. 
Indeed what we will prove is a local regularity result. These results are similar in 
nature to those proved in |ChL| |L] . In Section [6] we use the integral version of the 
method of moving planes ( |GNNj ). which was discovered in |CLQ2j . to deduce the 
symmetry property of the nonnegative critical functions. Here we will need some 
ideas from |Hn| again. 

Acknowledgment: The research of F. Hang is supported by National Science 
Foundation Grant DMS-0501050 and a Sloan Research Fellowship. The research 
of X. Wang is supported by National Science Foundation Grant DMS-0505645. 
The research of X. Yan is supported by National Science Foundation Grant DMS- 
0401048 and an IRGP grant from Michigan State University. 

2. Basic inequalities for Poission integrals 

The main aim of this section is to record some basic estimates associated with 
Poission kernel and harmonic extensions which we will use freely later. For xo £ M. n 
and r > 0, we write 

B?(x ) = {xeR n : \x-x \ <r}, B™ — B™ (0) , = B™ n E™ 

and 1?* (xq) to mean the closure of B™ (xq). Assume n > 2. For t > 0, £ £ R n_1 , 
we write 



nuj„ 



i/2 ' 



Jn (\i\ 2 +t 
Clearly we have 

• p ( x , = P Xn (x' - for x G R%, £ G E n_1 . 

• (Pf) (x) = (P Xn * f) (x') for x e R%. 

_ (ti-i)(p-i) 

• \ p t\ L p(M.n-i) = C i n -.p) t " for ^ir < p < °°- 

Recall if X is a measure space, p > and u is a measurable function on X, then 

Ml?,, (X) =supi||u| >t\ 1/p . 
w y ) t>0 

The space (X) = ju : u is measurable and Mj,p^pf) < °°|- More generally, 
for any < p < oo and < q < oo, we have the Lorentz norm H^p.^jq and 
Lorentz space (X) (see [SW| pl88]). L p w (X) = LP>°° (X) is a special case of 
such spaces. 

Proposition 2.1. We have 
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and 

(2-1) iPfl^^^c^p)]/]^.^ 

for 1 < p < oo . Moreover for 1 < p < oo we have 
(2.2) IP/I j^, , < c(n,p) l/l .jj, 

Proof. We only need to prove the weak type estimate. The strong estimate fol- 
lows from Marcinkiewicz interpolation theorem (see |SW[ pl97]) and the basic fact 
I^'/Il°°(r") — I/Il^r™- 1 )- To prove the weak type estimate, we may assume / > 
and |/| L i( Rn -i) = 1- First we observe that (Pf) (x) < for x G R" and 

f (Pf)(x)dx= f d£ ( f (0 f dx n f P(x,Odx')=a 

for a > 0. Hence for i > 0, 

|P/>*| = [i£i;:0<% <c(n)t-^,(P/)(x) >i} 

(P/) (ar)da; = c(n) 



1 

< - 

The weak type inequality follows. 



□ 



Later we will also need some elementary estimates for the harmonic extensions. 
They are listed below. 

• For 1 < p < q < oo, we have 

\ p t * /l/„«(R«-i) < c{n,p,q)r (n ^ 1] ^^ \f\ L P(^-x) ■ 

• Assume / (£) = for |£| > P, then we have 

c (n) t 



\(P t *f) (01 < 



f 2 



(del -#r 

• Assume / (£) = for |£| < P, 1 < p < oo, then we have 
\Pt * /lioc^-i) < c{n,p)tRT ,J -^- 1 |/| LP(R „-i) 



and 

For t > 0, £ G let 



|i7l r W B +. ^ <c(n,p)P"— 

lei 



f nit;,, 



(Kl 2 



i/2 ' 



then 



\QAlp( 



(n-l)(p-l) 

c (n, p) £ p for 1 < p < oo. 
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• Let <p e L°° (R"- 1 ) n Lip (R"- 1 ), then 

\P t * (<pf) -<p{P t *f)\< M Lip(JR «-i) tQt * /■ 

In particular, it follows from Hausdorff- Young's inequality that 

\Pt * iff) -<p(Pt*f)\ L ^-i) 
< c(n,p,q) [<p] Up(Rn -i ) t 1 ~ (n ~ 1 ^p~^ |/Lp (m »-i) 
for 1 < p < q < oo. 

As a simple application of these estimates, we derive the following compactness 
result. 

Corollary 2.1. For 1 < p < oo, 1 < <z < -^r, ifte operator 

P:W (IK™ -1 ) — ► i* oc (E») 

is compact. 

Proof. Assume G L p (R™^ 1 ) such that l/il/wR™- 1 ) < 1, it follows that 



\(Pfi){x)\ <c(n,p)x n p forzS 



By the gradient estimates of harmonic functions, after passing to a subsequence we 
have Pfi -> u in C^ c (R™)- For any i? > 0, 

= / - Pfj\ 9 dx+ f \Pfi - Pf,\ q dx 

JxEB^,x n >s J x£B+,x n <e 

\Pf t -Pf 3 \ q dx + c(n,p,q)e 1 - {n ~ 1) (i- 1 \ 



< 



Hence 

Iim sup \Pfi-Pftf , + ,<c(n,p,q)e 1 - ( - n -V(i- 1 ). 

Let e-*0 + , we see Pfi is a Cauchy sequence in L q loc (R"). □ 

Finally we derive a dual statement to Proposition 12.11 Let u be a function on 
R" , we write 



(Tu)(0= / P(x,0u(x)dx. 

Proposition 2.2. For 1 < p < n we have 

(2.3) \Tu\ < c(n,p) |w| iP / R n 

/or any u E LP (Ml) . 
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Proof. We may prove the inequality by a duality argument. Indeed, for any non- 
negative functions u on W\ and / on R n_1 we have 



0</ (T«)(0/(Od£= / P(x,Z)u(x)f(Odx 



+ 



(Pf) (x) u (x) dx < \Pf\ L ^ (R „ } \u\ Lp{n) 



< c(n,p) \u\ Lp(R1 \ l/l (n-i)p 

L^(P-I) (Rn-l) 

Inequality (|2.3[) follows. We may also prove such an inequality directly. Indeed, 
since 

\PU)\ L ^ {Kn+) = |P(-,0)| L ^ K) = c(n)< oo, 

we see T : L™' 1 (R™) — > L°° (R™ -1 ) is a bounded linear map. On the other hand, 
for u e L 1 (R"), we have 

\(Tu)(0\dt< [ d£ [ P(x,0\u(x)\dx= f \u(x)\dx. 

- 1 JR"- 1 JR™ JR^ 

Hence T : L 1 (R'|) -> L 1 (R"" 1 ) is also bounded. The inequality Q3) follows from 
the Marcinkiewicz interpolation theorem. □ 

3. The existence of maximizing functions for sharp inequalities by 
the concentration compactness principle 

Assume n > 2 and 1 < p < oo. Let c n<p be the sharp constant in (|2.ip . then 
c n ,j9 > and 



(3.1) ci^^sup |P/|— : / e (M"- 1 ) , |/| 



The aim of this section is to show Cn,p is attained by some functions. Let / 
be a function defined on R n_1 . For A > and ( e R™ -1 we write (£) = 

\~^~ f {^jPj for £ S M™" 1 , then 

|/ A ' C Lp(R»-1) = I/Ilp(R-i) > \ P f ' Ijr^gn) = l P ^ L ^( R ") ■ 

In particular the variational problem (|3.1[) has both translation and dilation invari- 
ance. The problem fits in the general frame of concentration compactness principle 
of [Lionj . We will apply this principle to prove the following result. 

Theorem 3.1. Assume n > 2 and 1 < p < oo. Let fi be a maximizing sequence 
of functions for I13.1\) , then after passing to a subsequence there exists Xi > and 
Q € R" -1 such that f^'^ — > / in L' p (R™ -1 ). In particular, there exists at least 
one maximizing function for the variational problem \3.1\) . 



A basic ingredient in the proof of Theorem 13.11 is the following proposition cor- 
responding to [Lion! lemma 2.1]. 

Proposition 3.1. Assume n> 2, 1 < p < oo and fi S L p (R n_1 ) such that fi—*- f 
in L p (R™" 1 ). After passing to a subsequence, assume 

\fi\ p d£ -^fxinM (R™- 1 ) , \Pfi\^ dx^v in M (1^) . 
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Here M. (K™ _1 ) denotes the space of all Radon measures on M n_1 . Then we have 

y\ n = \Pf\^dx. 
Moreover for any Borel set E C K n_1 ; 

• There exists a countable set of points Q £ R' i_1 such that 

3 3 

here /ij = A*({Cj}) and 

n-l 1 

vf V < Cn,pVj ■ 

Tl-l 1 

• If v (R™ -1 ) np > c„ )P /x (R™ _1 ) p , then v is supported on a single point. 
Proof. Without losing of generality, we may assume |/t| j,j>(Rn-n < 1- Since 

\(Pfi)(x)\ <c(n,p)xn^ forxeR^, 

it follows from the gradient estimate of harmonic functions that Pfi — > Pf in 
C,~ (R™) ■ In particular, 

v\ n =\Pf\^dx. 
Let ip G C* c °° (M"- 1 ) and rj G C c °° ([0,oo)) such that < 77 < 1, we have 
H*'M*n)(P/i) COI^^ 

< |t? (*„) P (z)!^ + ^ (z„) (a/) (P/<) (i) - P (p/i) (z))| £ ^ (r „ } 



< 



Cn, P k/ili,i»(Rn-i) +c(n,p)|V¥?| iaa(K »-i) 77 (t) i ""-1 ^ 



Now fix an 77 G C°° ([0, 00)) such that < 77 < 1, r) (0) = 1 and 77 (£) = for i > 1. 
For e > 0, denote ?7 E (t) = r\ (t/e). Then 

\<p(x')T) e (x n ) (Pfi) (x)\ L ^e T , . 

< Cn,p\<Pfi\LPQt»-i) +c(n,p)\Vip\ Loo(Rn _ 1) e. 
Letting i — > 00 and then £ — > + , we see 

A limit process shows for any Borel function h on R n_1 , 

i/p 

\h\^du) < Cnp l I \h\ p df t' 



-1 
-1 



This implies for any Borel set E C R n_1 , v (E) "■*> < c n , v n(E)p . In particular, 
^ is absolutely continuous with respect to fi. By Radon-Nikydom theorem ([EG] 
section 1.61) we have 



v i E )= / 

J E 
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Moreover for fj, a.e. £ £ R n_1 



9(0= lim 



Let J = {£ € R™ -1 : /«({£}) > 0}, then J is countable. Moreover, for £ </ J, we 
have 

g (£) < lim inf clj/x (fi? -1 {£)) ~ = 0. 

Hence ^ = |P/| dx+J^ ^j^Cj • For ^ ne third assertion, if we know v (R"" 1 ) " p > 
c n , P n (R" _1 ) 5 , then 

l/p / v l/p 



hence 

Since < 2i — ^ < 1, we see at most one Va is nonzero. □ 

Now we are ready to prove Theorem 13.11 
Proof of Theorem HOI For r > 0, let 



fa(r) = sup / 

CeR'*- 1 Jb^-^q 

Then fa : (0, oo) — > [0, 1] is a continuous nondecreasing function with 

lim fa (r) = 0, lim fa (r) = 1. 

r — >0+ r — *°° 

By introducing dilation factor Ai and translation by we may assume 



fa{l) = 1/2= / |/«. 

After passing to a subsequence, we may find / £ L p (R™ -1 ) such that 
fi ->■ / in ^ (R"- 1 ) , |// d£ - M in .M (R"" 1 ) , \Pfi\^ dx v in M . 

In particular, this implies /i ^£?" ^ > 1/2. We claim /i (R™ -1 ) = 1. If not, 

then fi (R n_1 ) = 6 £ (0, 1). For e > small, we claim that after passing to a 
subsequence, we may find r > and a sequence fj — ► oo such that 



< / \fi\ p de< f \fi\ p dS<B + e. 



Indeed, fix r > such that fi (-B™ > 8 — e, then for i large enough, we have 
J B n-i \ fi\ p d£ > — e. On the other hand, since /x ^B^ +2i) + we may 
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inductively define m > i, rn+i > rn such that f R n-i \f n ,\ p dx < 8 + e. Replacing 
fi by fm we get the needed claim. Let 



ft = /iXs?" 1 . k i = /iX K n-l\ S n-_l 



r Q +2r 



Since 



we see 



Note that 



/ l/«<2 £ , 

JB?-J 2ri \B?-i 



\fi-gi - /ii|i,p{R«-i) < c(n,p)e 1/p . 



np np 



\P 9i + Phi\— - \P gi \— - \Phi\ — 
<c{n,p) (jPgil^' 1 \Phi\ + \P 9i \ IP^I^ 1 ) . 
On the other hand, 

/ \Pg^^\Ph t \dx 

<\PgA^ P ~ 1 \Phi\ _«£.- + N + iPgd^T 1 IP/id _2il. 



(p-lUnp-n+l) 



<c{n,p)R p r l p +c(n,p)r 



this implies 



((|a/|-r ) + ) 2 +^ 



-1 n/2 



L»-i(R»\B+) 



lim sup / iP.gil^ 1 1 |P/i,|dx 

i^oo JR™ 



(p-l)(np-n+l) 



< c(n,p) r 



Let R — > 00, we see 



((l^'|-^o) + ) 2 +: 



'72 



L»-i(R»\B+) 



Similarly 



Hence 



lim 



lim / \Pg^ 1 \Ph l \dx = 0. 
lim / \Pg t \\Ph t \^- 1 dx = 0. 

JR™ 



/ \P gi + Phi\& -\P gi \& -\Phi\ 



= 0. 
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Since 



np np 



/ \Ph t \—dx < c^p 1 N^-i) < c^p 1 (1-6 + e)— , 



we see 



Cn.p 1 + o(l) 

\Pfi\^dx 



< (\Pg l + Ph l \ L ^ i{Rn+) +c(n,p)e 1 /? 

< { \Pg t + Phi\^ dx + c{n,p)e 1/p 
Jr™ 

< / (\Pg l \^ T + \Ph l \^)dx + c{n,p)e 1 lv + o(l) 
Jr™ v y 

Tip Tip 

<c^ + + (1 -6 + e)— +c(n,p)e 1 /P + o(l). 

Letting z — + oo and then e — ► + , we see 

n n 

1 < 6»— + (1 - 0)— . 

This gives us a contradiction since > 1. Hence \i = 1. Next we 

claim v (Wf) = Cn,p X ■ Indeed, for any s > small, we may find r > such that 
\i > 1 — e, this implies |/i| p <i£ > 1 — e when i is large enough. Hence 



then 



1/p 



(n-l)(p-l) 

\(Pgi) (x)\ <c(n,p)r 



((\x'\-r) + ) 2 +xl 



n/2 " 



This implies 



/ np 

/ \Pfr\~dx 

Jr™\B+ 



< c(n,p)e^ +c{n 1 p)r n{p 1} 



((M-r)" 



n/2 



L^T(R"\B+) 
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Taking a limit for i — ► oo, we see 
v (If) > ^ C&h 



"■P n 

> cZ'p 1 -c{n 1 p)e~ - c(n,p)r" (p_1) 



((|x'|-r) + ) ; 



-i n/2 



Ln-l( B n\ B +) 



let i? — > oo then e — > , we see f (R") = c,"^ 1 . 

By Proposition 13.11 we know there exists a countable set of points Q € R" -1 
such that 

i/ = |p/|^ + ^ ufa , n > \f\ p + E . 

here /ij = /z ({Cj}) and 

n-l i 

If / = 0, then ^(R™- 1 ) = c^f" and hence u (W 1 - 1 )^ = c n ^ (R™" 1 ) » . This 

rap 

implies for some £i € R™ _1 , v = cj^p 1 <5^ 1 . In particular, /i({Ci}) > 1 and this 
implies /i = 8^ . But 

/ \fi\ p dt<l/2 
implies /i (-B™ -1 (Ci)) < 1/2- This gives us a contradiction. Hence / ^ 0. Now 

tip _ — T n P n P np — ^ n 



hence 



But since 



i 

1 > i/iIp( R »-i) 



and > 1, we see fj,j = and |/| iP ™„_n = 1. This implies /j — * / in LP (R™ 1 ). 



□ 



4. The EXISTENCE OF MAXIMIZING FUNCTIONS FOR sharp inequalities by 

SYMMETRIZATION 



Following Lieb ( |Li2j ). using the method of symmetrization we will show all the 
maximizers of variational problem (|3.ip are radial symmetric with respect to some 
point and we will give another approach to the existence of maximizing functions. 

Let u be a measurable function on R", the symmetric rearrangement of u is 
the nonnegative lower semi-continuous radial decreasing function u* which has the 
same distribution as u. It satisfies the following important Riesz rearrangement 
inequality f |LiL[ p87]): for any nonnegative measurable functions u, v, w on R", we 
have 

/ dx I u (x) v (y — x) w (y) dy < dx u* (x) v* (y — x) w* (y) dy. 
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Using the fact |w|lp(r™) = I u '*Ilp(R") f° r P > 0, we see for 1 < p < oo, 

\u*v\ LP(JS ,n ) < \u* *v*\ LP(Rn) . 

Moreover if u is nonnegative radial symmetric and strictly decreasing in the radial 
direction, v is nonnegative, 1 < p < oo and 

I u Hz,p(r») = I«* w *Ilp(R") < °°) 

then for some xq £ R™, we have v (x) = v* (x — xq). 

Indeed, we may assume v is not identically zero. Choose a nonnegative w S 
U>' (R«) with \w\ LP > (Rn , = 1 such that 



l u Hz>(R>.) = / {u*v){y)w{y)dy. 

JR» 

Then we have 

I u * w Ilp(r™) = / dx / u(x)v(y - x)w{y)dy 



< I dx u(x) v* (y — x) w* (y) dy 

JR™ 

(u*v*) (y)w* (y) dy 



< \ u * v *\ L p(R") = \ u * v \ L p{R") . 

hence all the inequalities become equalities. It follows from the Lieb's strong version 
of Riesz rearrangement inequality f |Lil| ) that for some xq £ R ra , v (x) = v* (x — xq). 

Theorem 4.1. Assume n > 2 and 1 < p < oo, then the value 

eg 1 = sup j jf ^ \Pf\& dx:f£ ^ (M"- 1 ) , \f\ LP ^n- 1} =l\, 

is attained by some functions. After multiplying by a nonzero constant, every max- 
imizer f is nonnegative, radial symmetric with respect to some point, strictly de- 
creasing in the radial direction and it satisfies 

(4.1) f{0 P ~ l =l P(x,0(Pf)(x)^- 1 dx. 



If n > 3 and p = 2 (" - 1 ) , then any maximizer must be of the form 



/(0 = ±c(n) 



A 2 + k-6| 2 . 



for some A > ; £o € R™ 1 . In particular, c g(n-i) = n 2 c™- 1 ) u> n 2 ™ ( ™ 
If n > 3 and p = 2 '"~ 1 ^ , i/ien any maximizer must be of the form 

A V 



/(0=±c(n) 



A 2 + ie-e | 



/or some A > 0, £ G R™ l . In particular, c ^-p = ^ 2 ^_ 2) ^ ( r^"^) 
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Proof. Assume fi is a maximizing sequence. Since |/»*|/,!<(r..-i) = |/»Ilp(r»v-i) = 1 
and 



If fi\ n P — / \Px n * fi\ dx n 



/'OO 

< 



pOO n p Tip 

J l P *»*tflSr ( R»-i) d!rn = |P/;I l^t(e ? )' 



we see /* is again a maximizing sequence. Hence we may assume fi is a nonnegative 
radial decreasing function. 

For any / e LP (R"" 1 ) and any A > 0, wc let f x (£) = f (f), then it 

is clear that l/^^-i) = |/| L p(R»-i) and l P / A | L ^r ( R ») = \ P f\ L -£b(R*y For 
convenience, denote e\ = (1, 0, • • • , 0) e M™ and 



Oi = sup (ei) = sup A 1 /i ( -r 

A>0 A>0 \ A 

o < /i (o < ai ler 2 ^ 

I/*Ilp.« , (M»- 1 ) - W ti'-l a >' 

<c(".P)l/il5( R »)l/<lt,oc (R » ) 

< c(n,p) al /n , 

this implies ai> c (n,p) > 0. We may choose Ai > such that f i * (e^) > c (n,p) > 
0. Replacing fi by f Xi we may assume /(e^) > c(n,p) > 0. On the other hand, 
since fi is nonnegative radial decreasing and |/»|i P (Rn-i) = 1, we see 

i/i(oi<^ p i^r (n - 1)/p . 

Hence after passing to a subsequence, we may find a nonnegative radial decreasing 
function / such that /» — > / a.e.. It follows that /(£) > c{n 1 p) > for |£| < 1, 
/< - / in LP (R"- 1 ) and l/l^^-i) < 1. Since 



It follows that 
and hence 
Now 



/ 



\\fi\ P -\f\ P -\fi-f\ P \d^0, 
we see 

\fi ~ /Ilp(R"-!) = l/*ll,P(R«-i) ~~ l/ll,P(R»-i) 

= 1-1/1^-^+0(1). 
On the other hand, since (Pfi) (x) -> (P/) (x) for a; € R" and l-Pfil^^^ < 
Cn jP , we see 

L™-i(R") L"-i(R") 

Tip Tip np Tip 

— C ™,P l/l LP(R n_1 ) + Cn 'P I/* ~~ /IlpQR*- 1 ) ("0 ' 
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Hence 

np np 

1 < l/I^Rn-l) + I/' - /I£p(V-1) + ° (!) • 

Let i — > oo, we see 

1 < l/lippin-l) + ^1 - l/liP(M»-l) J 

Since > 1 and / 7^ 0, we see |/| LP( - R „-i) = 1. Hence /j — > / in L p (R" _1 ) and 
/ is a maximizer. This implies the existence of an extremal function. 

Assume / G LP (R" -1 ) is a maximizer, then so is |/|. Hence \Pf\ L _s£_ = 

|P|/|| v On the other hand, since \{Pf) (x)\ < P(\f\) [x) for x G R" + , we 

see |P/| = P (l/l) and this implies either / > or / < 0. Assume / > 0, then the 
Euler-Lagrange equation is given by 



/ 



p(x,o (Pf)(x)^- i dx = c -f(tr- 1 . 

Here c is a constant. Using the fact |/| iP ( R n-i) = 1, we see 



np 



c=\Pf\ n ^ t =cl 

L»-i(R£) 

After scaling by a positive constant we get 

P(x,0 (Pf) (x)^- 1 dx = f (Zf- 1 . 



I 



On the other hand, we know for x n > 0, |P X * f| _^p_ — \P X * f*\ jip_ , 

this implies / (£) = ./*(£ — Co) for some £ - It follows from the Euler-Lagrange 
equation that / must be strictly decreasing along the radial direction. 

For the case when p = ^2-, we hrst observe that if / G i 2 ^" (M™ -1 ), let 
u = Pf, 7(0 = ]tfk=zf (j^) and u{x) = i^p^u (l^p)' thcn we havc S = P /' 
f 2(n-i) = Ifl 2(n-ii and \u\ _2rj_ = |u| 2n . This is the 

conformal invariance property for the particular power. As a consequence, if / is a 
maximizer which is nonnegative and radial, then —7=7/ (j^r ~ e 'ij 1S a maximizer 

too. In particular, ^n-a / (]^ — e i) ^ s ra dial with respect to some point. To find 
such /, we prove the following facts. □ 

Proposition 4.1. Let n > 2, u be a function on R™ which is radial with respect 
to the origin, < u (x) < 00 for x ^ 0, e\ = (1,0,- •• ,0), a G R, a 7^ 0. If 

v (x) — \x\ a u (^j^z — e i) is radial with respect to some point, then either u(x) — 

/ . ,2 W 2 

I Ci |ar| + c 2 ) for some c\ > 0, c 2 > or 

u(x) = ! Cl| f' !/ n ^°' 

1 C 2 , l/x = 0, 

/or some C\ > and C2, an arbitrary number. 
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Proof. First we observe that 
we have 



= 1 if and only if x\ — |. For r > 0, r ^ 1, 
= r if and only if a; € flfl 2 r ^ ^ jj^a ^ ■ By scaling, we may 
/ i\ a l' 1 

assume u (ei) = 1. Then v (|, a;") = ( j + J . Assume t? is symmetric with 

respect to z — [zi, z"). Then v (i, •) is symmetric with respect to z", hence z" = 0. 
Denote z — ae\, we claim < a < 1. If this is not the case, then we may hnd a 

r > 0, r 7^ 1 such that a = j^pi- Now on dB ^ r (tzt^) t v ( x ) — M" u ( re i) an d 



v (x) = (\x — ae\ | 2 + a — a 2 ^j 



l 

2 

a/2 



., . .. ; , we have 



a/2 

for all 



Hence 

u fa) = ( l x ~ ae i| + a — a 2 ) = ( |x| — 2axi + a) 

for | a; — ae±\ > || — a|. When a = |, we see t> (x) — (\x\ 2 — 2axi + aj 

I 2 \ a / 2 

x. This implies u (x) = ( h \x\ + § ) • Hence we assume a / ^ from now on. 
Without losing of generality we assume < a < | . We claim that 

/ 9 W 2 

(4.2) i! (a;) = (|a;| -2axi + aJ 

for all i^O. To see this, we first make the following observation. Assume for some 
given r > 0, r ^ 1 and for some y S 9-B_n_ (r^ 3 ) > H-^P i s true for y, then it is 



true for all x £ r)B jr ( ) . Indeed, for x on such a sphere, we have 



= r — 1. 



H 2 



Hence 

a/2 



u (x) = |a;| Q u (rei) = |x| Q \y\ a (jy| 2 - 2ayi + aj 

x\ 2 — 2ax\ + a 



a(l-2l 1 )\ /. |2 „ \a/2 



kl 2 



Note that we know (|4.2p is true for a; = tei with i S (— oo, — i]. By the above 
observation we know it is also true for tei with t € [4, i] . This implies it is true 
for tei with < S (— oo, — |] . Go back we see it is true for tei with t S [|, |] . Keep 
this procedure going, we see (|4.2p is true for all fei with i 7^ 0. Hence it is true for 

/ 2 \ a / 2 

all .t 7^ 0. This implies u fa) = I a \x\ + 1 — a) □ 

Remark 4.1. 27ie case w;/ien a = is a little bit different. However one has: 
Let n > 2, u be a function on K.™ which is radial with respect to the origin, e\ — 
(1,0, ••• ,0). If v (x) = u ^t^t — &ij i s radial with respect to some point, then 
either 

ci, ifx = 0, 



u (x) 



c 2 , ifx^O, 
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or there exists r > 0, r ^ 1 such that 

!ci, if \x\ < r, 
C2, «/ |a;| = r, 
c 3 , if \x\ > r. 

Here Ci 's are arbitrary constants. 

Proof of Theorem\4-l\ continued. Since 1/1 2(n-i) = 1 and it is strictly de- 

L »-S (Rn-1) 

creasing along the radial direction, we see < / (£) < oo for £ ^ 0. Note that since 
/ satisfies the Euler-Lagrange equation, it is defined everywhere instead of almost 



everywhere. It follows from Proposition 14.11 that / (£) = ^ci|£| 2 + C2j for 
some c\ , C2 > (note that / can not be a constant function and the scalar multiple 
of |£| "is ruled out by the integrability) . A simple change of variable shows 



f % = (c lC2 y 



i + ier 



-(n-l) 



Hence c\C2 = c (n). It follows that for some A > 0, / (£) = c (n) 



A 

A 2 + |«|" 



. Let 



(0, • • • ,0, 1). Since u (x) = \x + e„| ™ is a bounded harmonic function on 



andu(e > 0)= + 



, we see 



By the dilation invariance 



(x) = \x + e„| 



2-n 



:r + e, 



1 2— n 



£n-2 



C 2(„-l) 



( R +) 



For the case when p — 2 ^" ra ^ , we know any maximizer after multiplying by a 
constant will be nonnegative and satisfy 

/(C) 



P(:r,£) (P/) (a:)dz = c(n) 



IC-CI 



Let g(0 = f then .g e L~^~ (E n_1 ) and 

.9 (£) = c (n) 



(„-!) + ! 

D-i ai »- 



It follows from |CLQ2| theorem 1] or [L] that for some A > and £o G M n_1 , we 
have 



Hence 



5 (£) = c(n) 



/(0 = c(n) 



A 



,A 2 + ie-c r 

(a 2 + |C-Co| 
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Since u (x) 
we see 



\x+t\ n 1S a bounded harmonic function on M™ and u (£, 0) = + 

x n + 1 



(i + iei a )" T )(«) 



| a: + e n |" ' 



By the dilation invariancc 

x„ + l 



|x+e„| n 



C 2(„-l) — 



^(R») 



1 + 



2\ 2 



1 f (n-2)I 
V / 2F 3 2)^\ r ( n T i ) 



□ 



As a final note, we point out the similar statement to Proposition ^, ll in dimension 



Proposition 4.2. Assume u <E C 3 (R), u > 0, a <E M suc/i i/iai /or any y 6 K, 
|x| a u (— + y J is symmetric with respect to some point, then for some a > 0, b > 

r „ -ia/2 

and xo £ M, we have u [x) = a [x — xq) + b 

Proof. Assume \x\ a u (— + y) is symmetric with respect to z = z (y), then 



|.r| (/ I - + y 



|2z — x\ a u 



1 



Replace x by x _1 , we see 

u (x + ?/ i = 1 1 — 2.:..rj" // ( // ■ 

Calculation shows 
|1 — 2zx\ a u I y 



2z — x 



1 - 2zx 



1 - 2zx 

u (y) ~ <y (y) + 2azu (y)) x + 

u'" (y) 



u" (y) 



+ 2 (a - 1) zu' (y) + 2a(a- 1) z 2 u (y) I x 



( . + (a - 2) z«" (y) + 2 (a - 1) (a - 2) z 2 u' (y) + -a (a - 1) (a - 2) z 3 u (y) 
+ o(x 3 ). 

Comparing the Taylor expansion coefficients, we see 

u ' (y) = -azu (y) 

and 

u'" (v) 4 

— — + {a-2) zu" (y) + 2 (a - 1) (a - 2) z 2 u' (y) + T a{a- 1) (a - 2) z 3 u (y) = 
3 3 

If a — 0, then we see u' = and hence w must be a constant function and we are 

done. Assume a^O, then 

«' (y) 



au (y) ' 



Plug this in the second equation, we get 



u 2 u"' + 3 



1 ) uu'u" + 



2|«' 3 = 0. 
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Hence 



2/ a) = 



2 III i o 
U 11 + 3 



- - 1 ] uu'u" + (- -l](--2 
a I \ a I \ a 



= 0. 



The proposition follows. 

5. Regularity of nonnegative critical functions 



□ 



In this section we will study the regularity issue related to the Euler-Lagrange 
equation (|1.9[) . Let / be a nonnegative function satisfying (|1.9[) . define u = Pf, 
then the single equation becomes an integral system 



u (x) 



-l 

P(x,g)u(x)'^ I ~ 1 dx. 



This system is very similar to the one appeared in the study of the sharp Hardy- 
Littlewood-Sobolev inequality ( [Li2[ part (ii) of theorem 2.3]). In |ChL[ IT] the 
regularity problem for some cases of that system was resolved by a linear approach. 
In [Hn] , a nonlinear approach was introduced to resolve the regularity issue for all 
the cases. We will apply the nonlinear approach to handle (|1.9[) . 



Theorem 5.1. Assume n > 2, 1 < p < oo, / € Lf 0i 
identically zero and it satisfies 



is nonnegative, not 



f(0 



p-l 



P(x,0 (Pf) (x) 



dx, 



then f e C°° (R"- 1 ). If we know f £ LP (R^ 1 ) , then f (0 as |£| oo. 
We note that the condition / e Lf oc can not be dropped, since the above 

_ n — 1 

equation has c(n,p) |£| p as a singular solution. To prove this theorem, we first 
derive some local regularity results for some integral inequalities. According to the 
range of p, we need two local results stated in Proposition 15.11 and Proposition 15.21 
below. The two propositions are of the same nature as |Hnl proposition 2.1] and 
[L"l theorem 1.3]. 

Proposition 5.1. Given n > 2, 1 < a, b < oo, 1 < r < oo, < p < q < oo such 
that 

1 r 1 r 1 
-<-+-<-+-<l 
n q a p a 

and 

n n — 1 1 



ra 



B n ~ x and B+ 



Denote Br 

F E L b (Br) are all nonnegative functions with v\ 



Bft n K™ . Assume u,v G £ p (B+) , U e L a (B+) , 



G L g [Bt 



1^1 l°(b+) \ F \l"{b r ) <£( n iP,<l, r , a i b ) small 



and 



u(x)< / P(x,^)F(0 

J Br 



P(y,OU(y)u(y) r dy 



l/r 



d£ + v (x) 
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for x G Bfi, then we have u\ B + G L q \B^j^j and 

I u Il,( B ; /4 ) <c(n,p,q,r,a,b) (pf"? \u\ lv ^ b+r) + M L ,( s + /2 )) ■ 

Proof. By scaling we may assume R = 1. First assume we have u,v <E L q (P^)- 
Denote 

/(£) = [ P(x,OU(x)u(x) r dx for£e B x . 

JB + 

Let pi and qi be the numbers defined by 

n — 1 nr n n — 1 nr n 

= — + --1, = — + 

Pi P a qi q a 

then it follows from Proposition 12.21 that 

|/liPi( Bl ) <c(n,p,r,a) |t/| Lo ( B +) |«|2p( b +) , 
<c(n,q,r,a) \U\ La ^ |u|2,(b+) • 
Given < s < t < 1/2. For x e P+, we have 

m (a;) 

< f P(x,OF(Of(0 1/r d£+ [ P(x,OF(Of(0 1/r dZ + v(x) 

JBs+t ■/.BiVBs+t 

2 2 

< / p^of (0/(0 1/r dC + 7-^l=T / ^(0/(0 1/r dC + «(x) 

^i+t {t - s) Jb 1 \b 1±1 



< 



l/r , £ , c(n,p,r, a) 



(t-s) 



n^T \ U \L P (B+) 



Hence 

M £ ,(B+) < c(n,g) |P| Lb(Bl) l/l^/ \ + C -^T^T- \<>{Bt) + l u L«( B + a ) 
On the other hand, for £ G £?s+t we have 

2 

/(£)=/ P(x,(,)U{x)u(x) r dx+ [ P(x,QU (x)u(x) r dx 

JB+ JB+\B+ 

< f P(x,£)U(x)u(x) r dx+ C(n } t „ 1 / LT (x) u (x) r dx 
Jb+ {t-s) Jb+\b+ 



< 



P(X,0 U W«W r ^ + ^p \ U \l*(B+) Mz,*(u+) 



It follows from Proposition 12 . 21 that 

\f\ Ln / \ ^ c 9, r, a) \U\ L ^ B +) l^lL( B +) + C ^^n-i a l f/ li-(B+) Ml*(b+) 
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Combining the two inequalities together, we see 

ii s 1 i i i C ("'-P'9' r ' a ) ii ,11 

if e is small enough. It follows from the usual iteration procedure f |HL[ lemma 4.3 
on p. 75]) that 



< c(n,p, 9 ,r,a) ( M iP ( B +) + |w| 



'WW 



To prove the full proposition, we note that there exists a function < rj (x) < 1 
such that 

l/r 



u(x)=r 1 (x) / P(i,OF(0 
We may define a map T by 



P(y,OU(y)u(y) r dy 



d£ + rj (x) v (x) . 



P(y,OU(y)\<p(y)\ r dy 



l/r 



Note that we have 

\ t ( ( p)\lp(b+) ^ c(n,p,r,a,b) |f/|^T( B +) l^li^BO Mlp(Bx) < ^ Mi^uo . 

\ t {<p)\l«(b+) < c(n,g,r,o,6) |f l^+j I^"Il*(bo \<p\l»(Bi) ^ \ \ ( p\l<>(b 1 ) 

if e is small enough. Moreover, for ip,ip & L p (Sj* - ) , it follows from Minkowski 
inequality that 

\T (<f) (x) - T (V) (a:)| < T fly, - VI) (s) for x e £?+ 

hence 

|T(<p) -T(V>)| if ,( B +) < |T(|y>- VI)lip( B +) < | - V'l jLP ( B +) - 
Similarly we have for any ip,ip S (Bi), 

\ t {<P)- t W\l«(b+) ^ \ \v-^\ L i{b+) ■ 

For fc g N, let (x) = min{t;(x) ,k}, then it follows from contraction mapping 
theorem that we may find a unique u k E Li (B+) such that 

u k (x) 

= T(u k ) (x) +t](x) v k (x) 

l/r 



= V (x) / P(x,OF(0 



P(y,t)U(y)\u k (y)\ r dy 
Applying the apriori estimate to u%, we see 

l Wfc li 9 (s+ 4 ) - c{n,p,q,r,a) (\u k \ LP ^ + \ v \ l *(b+ 2 ) 

u (x) = T (u) (x) + rj (x) v (x) , 



d£ + V ( x ) v k (x) 



Observe that 
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wc see 

K - u \ L p(B+) ^ \ T ( u k) ~ T ( u )\ L p(B+) + \ V k ~ v \ L p(B+) 

< \ \uk ~ u\ L p(b+) + K - v \lp(b+) ■ 

Hence \uk — u \l p (^b + ) — ^ \ Vk ~ v \lp(b + ) — > as £; — * oo. Take a limit process in 
the apriori estimate, we get the proposition. □ 

The other local regularity result is 

Proposition 5.2. Given n > 2, 1 < a, b < oo, 1 < r < oo, 1 < p < q < oo such 
that 

r 1 
< - + - < 1 

p a 

and 

n — 1 rt 

— = L 

Denote B R = and B+ = B^D E7J.. issme /,j £ L p (-Br), F <E L a (B R ), 

U G _L b (-B^) are a/Z nonnegative functions with 9\b r/2 *= \Br/2)i 

\ F \ 1 l°(b r )\ U \l<>(b+) - £ ( n >-P:9> r > a > fo ) sma ^ 

and 

-i l/r 



p(x,c)F(C)/(C)''dC 



/(0< / P(x,0f/W 

/or £ G -Bfl, i/ien u;e /iawe f\g R/4 G B 9 [B R /^j and 

l/li«(B R/4 ) < c(n,p,g,r,a,6) |/| lp(Sr) + M l ,( Br/2 )) • 

Proof. By scaling, we may assume i? = 1. First assume we have /, <? G B 9 (-Bi) 
Define 



w (a;) 



J B x 



for x G -BJ*~. Let p\ and gi be the numbers given by 

n n — 1 [n — l)r n n — l (n— l)r 

— = + - — , — = + - — . 

pi a p qi a q 

It follows from Proposition 12 . 1 1 that 

M iP1 ( B +) < c(n,p,r,a) |F| ia(Bi) |/|£ P(Sl) , 

Given 0<s<f<l/2. For £ G B s , a similar calculation as in the proof of 
Proposition 15.11 shows 

/(£)< / P Or, (*) U (x) 1/r dx + C /"'^j |/| £p(Bi) + g (0 ■ 

2 

Hence 

(/ | ^/„„,mrn . . . u.iVr , c(rc,p,g,r,a) 
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On the other hand, for x G Bt+t , we have 

u(x)< f p (x, o f (o / (o r de + i ■ 

Jb, (t - s) 

Hence 

< c(n,(Z,r,a) |F| ia(Si) |/|£ 4(JJt) + ° ^Z~f=^ \ F \l*( Bi ) l/lL^) ■ 

Combining the two inequalities together, we see 

I /I , c(n,p,q,r,a,b) 

\J\li{b s ) ^ 2 l-'li'C-Bt) H ^ _ ^n-i 1/ li*(fli) + I-9Il<!(b 1/2 ) 
when e is small enough. This implies 

I/Il«(b 1/4 ) ^ c(n,p,g,r,a,6) (|/| LP(Bl) + l$| L «(B 1/a )) ■ 

With this apriori estimate at hands, we may proceed in the same way as the proof 
of Proposition 1 5 . 1 1 to get the full conclusion. □ 



Now we are ready to derive the main results of this section. 

Proof of Theorem^ Let Po = /„ (0 - f(0 v ~\ u (x) = (P/) (a;), then 
< po < co, f G Lf o c +1 (R-- 1 ) and 

u (z) = / P (x, /o (0 P ° /o (0 = / ^ «o (a:) 
For i? > 0, we write B R = B^T 1 , B+ = B'% n and 

Jm n - 1 \B a 

f PQ+r. 

fn{0 = / PfoOuofc)**^ da;. 

JRI\B+ 

First we want to show u Q G L/ O "~ 1,po (m + and u R G L (B+)nL™ c (P+ U 

Indeed, since /o G -kfoc +1 (R™ -1 ), we see fo < oo a.e. on This implies i*o < oo 

a.e. on R™ . Hence there exists an xo G B^ such that uo (xo) < oo. It follows that 

k»-i\ BR y'^ < 00 and f*"- 1 ^* < °°- For < < lj 

x G -Bgjj, we have 

UR fo = I P (X, fo d£ < f ^P*;. 



It follows that u fl G Lf oc (B+ U P^ 1 ) . Since J Br P{-,0 fo (0 P ° # e LT^? 

"(P0 + 1) 



we know uo G L/^ 1>P0 (B^ U P^, x ). By choosing R arbitrarily large, we deduce 
that u G L/ " c " )P0 (R + ) and hence ur G if"- 1 )™ (P+). 
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Next we want to show f R e L Po+1 (B B )nI^ c (Br). Indeed we may find £ G Br 



such that J R „ P (x, £o) (x) ("-^po dx < oo. This implies 



f X n , \ , P0 t" , 

/ jttUq (x) c-^po dx < 00 

4\BJ(| X ,_ & |* + X ;)"' 2 

PQ + " 

and hence J Rre \ B + jfp" u o (a;) ( "" 1)p ° da; < oo. For < 9 < 1, £ e -B#,r, we have 

/«(£)= / P(x,Ou (x)T^dx<—^- E « Uo ( x )T^T»^ dx 

and hence € L^ c (-Br). To prove the regularity of /, we discuss two cases. 
Case 5.1. < Po < -^j- 

In this case, we have , Pa t" > 1. Fix a number r such that 

1 < r < — and r > — , 

(n-l)po Po 

then 

l/r 

1/r 



Jo (C) 1/r < {j B+ P (x,0 no (x)T^k dx^j + f R (£) 



Hence 

u (x) 



= [ P(x,Ofo(0 P °~ r ~ 1 fo(& /r d£ + UR(x) 

JB R 

<J b P(x,Ofo(0 P °^ 1 n B+ P(y^)u (y)TS^k- r u (y) r dy\ d^ + v R (x), 



I B R 

here 



vr (x)= [ P (x, fo (tT ^ 1 fR (0 Vr d£ + u R (x) . 

J B„ 

Since f R e L Pa+1 (B R ), we see v R G L$^$o (£+). On the other hand, for < 
< 1, x e Sg},, we have 



2 

<i/Ki 1/r / x / ^(^e)/o(er^ 1 ^+ — c(n ' p °L )P0 i/oi£o + i( Bjt ), 
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"(PO + l) 

hence v R G L^ 1){p °- r ~ L) (B+ U B^ 1 ). Let 



n(p + l) , Oo + l)r 



po+n - (n-l)p r' p r - 1 



Then £ + ^ = ± and 



Pa+n 



"(PQ+ 1 ) a n(p + l) 

(n-l)po 

For "l£2+ii < g < we have £ + ± > ±. It follows from Proposition 

[n— ljpo ^ {n— 1){pq— r 1 ) J q a n 1 



ICTthat u \ R + G L q (-BJ /4 J. This implies 



PQ+" 



/o (0 = / P (x, (a:)W=i555 + / fl/4 (0 < c (n, <?) |uq| , + f R/4 (£) 

When 9 > (n -1)P0 ■ SUCh a Ch ° iCe ° f q iS P° Ssible SmCe (n-lx£o + -r-l) > (i-Sw ■ 

In particular, we see /o|b h 8 G L°° {B R j^. Since every point may be viewed as a 
center, we see / G Lf£ c (R™ -1 ) and hence uq G L^ c ■ For any R > 0, since 

/ < 00 and / t^ u o (ar) ( "- 1)P0 az < oo, 

Jn»-i\B R l?| ^\s+ H 

we see G C°° (S+ U S^ 1 ) and f R G C*°° (-Br). It follows that f G C£ c (M"- 1 ) 
for < a < 1. In particular, /o (0 > for any £ G This implies u G 

C/oc f° r an Y < a < 1. Using the fact c? 2 log = X2 \x\~ 2 when n = 2, 

<9 n \x\ 2 n = (2 — n) a; n |x| ™ when n > 3 and the standard potential theory in |GT1 
chapter 4], it follows from bootstrap method that both uo and /o are smooth. If 

f £ LP (JR"- 1 ), then / G L Po+1 (R"" 1 ) and u G (W^) . If we go back 

to the proof with this fact and apply Holder inequality when necessary, we will 

PO + n 

get f G L 00 (W 1 - 1 ) and u G L°° (K"). This implies u,<"~ 1)P0 G L s (R T |) for 
(po+i; 

Po+n 



^2±ii < s < oo. Denote 



/ PQ + " 



\x\ 



!)P0 . 







Since IjWXBf G i^r- £ (K«), |jfeX R n\ B » G L^+ £ (R») and ^2+1) < n , we see 
[/ is continuous and U (x) — ► as |x| — > oo. It follows from fa = c(n) J7L„_i that 
/o (0 -> as |£| -> oo. 

Case 5.2. -4r < p < oo. 

n— 1 — ^ u 

In this case, we fix a number r such that 

1 < r < po an d r > — j 

Po + n 
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then 



Hence 



".,(a0 1/r < ( / P(x,a)fo(0 PO <%) 1 +u R (x) 1/r 



+ 



/o(0</ P(x,Ou (x)T^k- r ~' I I P(x,Ofo((T°- r fo(O r dC) dx+ 9R (0, 



l/r 



here 



9R (0= / P{x,t,)u {x)T^- r ~\ R (x) 1/r dx + f R (0 



i(PQ + l) 



Since u R e L c»-i)p (Bj), we see g_R € L Po+1 (-Br). On the other hand, for < 
6 < 1, £ € -Befl, we have 

P (x, £) u (x) ("-^po ~ r u R (x) 1 ^ r dx 



<\u R \ 1, \ \ I P(x,Ou (x)T^k- r 1 dx 



c(n) /" . po+" r -i , ,i/r , 

<|«Jt| 1/r / x / P(x,0u (x)T^k- r ~ 1 dx 

L° 



c(n,p ) , ir^ri? 



-^T-I^oi^x) 



(l-6») n i?i^+T L("-Dpo (S+) 

hence g R G L' oc (-Br) for any q < oo. Let 

Po + 1 , _ n(p + l)^ 



a 



po - r (po + — (n — l)j>o 

then 1^1 + H = 1, + I = e (0,1). For any p + 1 < q < oo, it 

follows from Proposition [521 that when R is small enough, we have /o G £ 9 (B R u). 
Since every point can be viewed as a center, we see /o G £^ oc (R™ _1 ) and hence 

u 6 -k;™" 1 (^+)- Using the equations of f and u , we see f G L™ c (R™ -1 ) 

and u e fe)- Now the arguments in Case O tell us / G C°° (R™ -1 ) 

and Mo G C°° (^+) > moreover, /o (£) — > as |£| — > oo under the assumption 
/ € LP (R™ -1 ). □ 

6. Radial symmetry of nonnegative critical functions 

In this section we will study the symmetry property of the nonnegative critical 
functions of the variational problem (|1.8|) . We will show any nonnegative critical 
functions are radial symmetric with respect to some point. As explained at the 
beginning of Section [5l (jl.9p may be viewed as an integral system which is very 
similar to the integral systems related to the Hardy-Littlewood-Sobolev inequalities. 
For the latter one, the radial symmetry of nonnegative solution for some special 
cases were solved in [CLOU ICLQ21 [L] . In particular, in |CLQ2j an integral version 



28 FENGBO HANG, XIAODONG WANG, AND XIAODONG YAN 

of the method of moving planes ( GNN]) was introduced and later applied in [CLOl] 
to resolve the symmetry problems for some cases of the integral systems related to 
Hardy-Littlewood-Sobolev inequalities. In |Hn| , some new observations were added 
and all the cases for the symmetry of the solutions to the systems were resolved. 
We will apply these new observations to (|1.9p . 



Theorem 6.1. Assume 1 < p < oo, n > 2. / G L p (R™ 1 ) is nonnegative, not 
identically zero and it satisfies 

/(0 P-1 = / P(x,0(Pf)(x)^- 1 dx, 



then f G C°° (R n x ), moreover f is radial symmetric with respect to some point 
and strictly decreasing along the radial direction. 

For the case n > 3, p = i the Euler-Lagrange equation has conformal 

invariance property and we may weaken the assumption a little bit. 

2(n-l) 

Proposition 6.1. Assume n > 3, f £ L l( ^~ 2 (R™ -1 ) is nonnegative, not identi- 
cally zero and it satisfies 



f(0~ 2 = / P{x^){Pf){x)—dx, 

JR™ 

then for some A > and £o G R n , we have 
/(0=c(n) 



A 



,A 2 + |e-£o 

In the proof of these symmetry results, we will need the following basic inequality: 
assume < < 1, a > 6 > 0, c > 0, then 

{a + c) 6 - (b + cf <a 9 -b e . 

For a G R™ 1 and s > 0, we denote 

/ m \ V* 

H. = (X>N ■ 

Proof of Theoremtfni By Theorem O we know / <E C°° (R"" 1 ) and /(£) 
as |e| - oo. Let <? = ^ = / = (*7) fr), then < g < oo, 

.g G L f ' +1 (R"" 1 ), v G L^ri (R™) and 

w(a;)=/ Pfi.OffCO'de. 0(0=/ P^M*)^^- 

JR™- 1 JR™ 

For A G R, denote 

H x = {£e R"- 1 : 6 < A} , Q A = {x G R J ; : xi < A} . 

For f G R n_1 , £ = (&,£")> denote £ A = (2A For x e R "> - T = (asi,aj")> 
denote x A = (2A — x\,x"). Define g\ (£) = g v\ (x) — v (x\) and 

Kl = {ee^: gx (0 > .g (0) , 6a = {* e : «a (x) > v (x)} . 
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By a simple change of variable, we see 

v(x)= [ P(x,t)g(t) q d{+ [ P (a*, Off 
Jh x Jh x 

f q + n f q + n 

g(0= P(x,Ov(x)T^dx + P{x x ,Ov(x x )T»=TKda 
JQx JQx 

Case 6.1. < q < 

* — n— 1 

In this case, we choose a number r such that 

q + n _•■ 
1 < r < — and q < r. 

(n-l)q 

We have 

v (x x ) - v (x) = [ (P (x, 0-P (x X ,0) (9 (&)« - 9 (0 q ) dt 
Jh x 

Hence for x € B x , 

< v (x\) — v (x) 
< [ {P(x,t)-P{xx,0)(g{Zx) q -g(Z) q )dZ 

<qr f P{x, g {i x f-^ (g ^ x ) 1/r - g (£) 1/r ) d£. 

A 

It follows that 
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|t>A-u| n(,+i) <c(n,g,r) ^ r 1 (^ /r - g 1/r J 



L . (B») 



On the other hand, for we have 



+ / P(a;,0«^A)^?^+ / P(x x ^)v(x) 

Jqx\bi Jqx\b v x 

< / P(x,£)v(xx) 7 ^« dx + / P(x A ,^)w(x)T ; ^ 
./b? Jby 



P(a;,^)w(a;)<"- 1 )<J dx+ / P (x x ,^) v (x x )^^ dx. 
Qx\Bl Jq x \B v x 



Since 



dx 



g(0= [ P(x,Ov(x)T^udx+ f P(x x ,Ov{x x )T& 
Jbi Jbi 

+ / P(x,£)v{x)T^ dx+ / P(x x ,£)v(x x )T^, 
JQx\B* JQx\BX 



i q dx, 
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WO see 



9(£>) 1/T '-9(0 



l/r 



< 



< 



P(x,^)v(x x )'^^ dx+ / P(x x ,£)v(x)~^= T ^ dx 



Pl-r.O r (.<•)"' r 'i dx + J P(x x ^)v(x x y " r:r > ; 



l/r 



l/r 



J (P{x,£,) 1/r v{x x )T^Tr ,P(x x ,Z) 1/r v(x)?^&^ ^dxj 
J (p(x,t) 1/r v(x)TZ%*,P(x x ,Q 1/r v(x x )?^fc^ ^dxj 



l/r 



l/r 



l/r 



|(J,J/)|[ P< to 



Here 



I = P(x, 1/r (v (x x ) <"- +1 ><^ - v (x) (™- +1 >^ ) , 
II = P {x X ,0 [V {x)T^J^ -v(x x )T^T^\ . 



Hence 



9(tx) 1/r -9(Q 1/r 



< 2 



l/r 



dx 



< 



P(x,£) (v (xA) ( "- +1 " 9r - ("-"'iV") 

A / 

2(<Z + n) ' / P{x,Ov{x x )^ ± ^- r (v(x x )-v(x)) r dx 



l/r 



(n — 1) gr 



This implies 



si""-* 1 " 



< 



2 (g + re) 
(re — 1) qr 

< c(n,q,r) 



L(3+l)r(B») 

/ P(a;,^w(x A )T^^" r ( u (x A )- w(x)) r (ix 
/by 



l/r 

t«+i(B«) 



(v\ - v) 7 



l/r 

L «+» ( B «) 



< c(n,g,r) M' ^+T) k*-t>l nu+n 

lTS=i75(bx) l("-i>* (ej) 

It follows from the two inequalities above that 



l/r l/r 



L(«+i)'-(B») 
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Here e\ — (1, 0, • • • , 0). After these preparations, we will use the method of moving 
planes to prove the radial symmetry of g and hence /. 

First, we have to show it is possible to start. Indeed, for A large enough, 
\g\ Lq +i( 2 \e' -b^) can ^ e arbitrarily small, this implies 



9l /r - 9 1/r 



1 

< - 

L(9+l)r(B») 2 



9l /r - 9 1/r 



l/r 1/r 

3a -9' 



L<9+l)r(B9) 



L(9+l)'-(B9) 

0. It follows that B 9 X = when A is large 



and hence 
enough. 

Next we let A = inf {A e R : B{, = for all A' > A}. It follows from the fact 
g(£) — > as |£| — > oo and g(£) > for all £ e K" _1 that A must be a finite 
number. By the definition of Ao we know g\ (£) < g (£) for £ e H\ . We claim 
that g\ = g. Indeed if this is not the case, then since 

v Xo (x) - v (x) = [ (P (x, - P (x Xo , 0) (9Xo (t) q - 9 d£ 



and 



9Xo (0-3(0 



Qa 



(P (a;, - P (a;A„ , 0) (*% («) ^ - « (») ) ■ 



we get 3a (0 < 9 (0 f or £ e Pa - It follows that X2Ae' 1 -Bj -> a - e - as A T A . By 
dominated convergence theorem we have M^+i^Ae^-B 9 ) ^ as A t A . It implies 



l/r l/r 

.9a - .9 7 



< 



L(«+l)r(B») - 2 



3 a A - 3 1/r 



L(9+l)r(BS) 



when A is very close to Ao and hence B g x = 0. This contradicts with the choice of 
A . Hence when the moving process stops, we must have symmetry Moreover we 
claim that g\ (£) < 9 (0 for £ € Pa when A > A . Indeed for any A > A we can 
not have g\ = g because otherwise g is periodic in the first direction and can not 
lie in L« +1 (R n_1 ). Hence g x < g in P A . 

By translation, we may assume g (0) = max^ eRll -i g (£), then it follows that the 
moving plane process from any direction must stop at the origin. Hence g must be 
radial symmetric and strictly decreasing in the radial direction. 

Case 6.2. < q < oo. 

71— 1 — ^ 

In this case, we choose a number r such that 

\7X — 1) q 

1 < r < q and < r. 

q + n 

We have 

.9(0) -3(0- y (p^o-p^a^))^^)^-^^)^)^. 
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Hence for ^ efi', 



0<.g(60-s(O 
< (P (x, £)-P (x, &)) (v (x x ) ™ - v (x) cfe 

P (.t, « (x A ) <^- r " (w (x A ) 1/r - « (x) 1/r ) 



< {q + n)r 
~ (n- 1)<? y B ; 

It follows that 

IffA - ff| i9 +i(B») 

< c(n,q,r) 



dx. 



q+n r -i 
= c(n,q,r)\v x \ [ n - 1 Q + 1) 

On the other hand, for i £ BJ, we have 



1/r l/ r 

v x ' —V' 



L «+« (B S ) 



njg±j> , , 

L ("-1)9 (B«) 



+ 



P(x,Og(Z) q dt- 



P(x x ,Og(^) 9 dC 



Hx\B* 



Since 



v(x)= [ P(x,t)g(O q dt,+ [ P(xx,0g(^) q ^ 



P(x,Og(O q dt+ I P(x^Og(^) q dC, 

H X \B° 



we see 



1/r 



l/r 



0<v(x x ) 1/r -v(x) 1/r 

<([ P(x,s) g f P(x x ,Og(O q dt 
\Jbi Jb{ , 

- (j^ P (x, g (0 q d ^ + J Bg P 5 (60 9 

- {j B J ( p ( *' e)1/r ( 9 (6)9/r - ' 9 ( ^ /r ) ' p {xx ^ )1/r ( 9 ^ )q/r - 9 { ^ q/r )) 

<2Up(x,0 (g(tx) q/r -g(O q/r ) r dA 

(\ 1 / r 
J Bg P(x,0g(tx) q - r (g(tx)-g(O) r dA . 
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Hence 



l/r l/r 
vJ — IT' 



"(g + l)r , % 



< 2 1 



l/r 



r»(<i+l) 



r ,l/r 



<c(n,g,r)|s5 r (9x ~ ff) L n+l, a3 s 

<c(n,q,r) l^l^+^g^ \g\ - 9\l«+i(b{) • 
Combining the two inequalities together we see 

|5a-5| l ,+i( 6 ») < c(n,?,r)|)jS I^L^Ae' -B<0 lffA ~ 9 ^ +1 (Bl) ' 

With this inequality at hand, we may proceed in the same way as in the Case UTT 
to get the conclusion that g is radial symmetric with respect to some point and 
strictly decreasing along the radial direction. □ 



Next we look at the special power p - 



2(w-l) 
n-2 ' 

2(7.-1) 



Proof of Provosition \6.1[ If we know / E L ™- 2 (R n - 1 ) , then it follows from The- 
orem HH] that / G C°° (M™ -1 ), it is strictly positive and radial symmetric with 
respect to some point. By translation we may assume / is radial symmetric with 
respect to 0. 

On the other hand, if / is a solution to the equation, let u(x) — (Pf)(x), 
7(0 = ]e\*=*f (j^) and = j^iu (|^t) , b y change of variable we know 

u(x)=(pf)(x), f(0^ = I P(x,0u(x)^dx 



In particular, / G L ™- 2 and satisfies the 



and / 2 ( n-i) = |/| 2 ( n-i) 

L "-2 (R«-i) L ™~ 2 (R"- 1 ) 

same equation. 

Let ei = (1,0,- •• ,0) G R n , then it follows from Theorem O that /i (£) = 
/ f]^ — e i) ^ s sm ooth and radial symmetric with respect to some point. It 

2{n — 1) 

follows from Proposition 14.11 and the fact that / 6 L ™- 2 (M n_1 ) that for some 



Since / satisfies the equation, it 



ci > and c 2 > 0, / (f) = (ci 1^1 + ^ 

follows that for some A > 0, / (£) = c (n) ( x2 +\^ 

Next we want to show under the assumption of the Proposition 16. 1[ / always 
This will be proved by contradiction. Indeed, if this is not 

2(ti-l) „ 

the case, then / ffi „_ 1 / (£) ™- 2 d£ = oo. Let g (£) = / (£) "~ 2 , w (x) = (Pf) (at), 
then 5o G ifj^ (E™- 1 ), 4„_, ff0 ^ = oo and 



lies in L^p- (W 1 ^ 1 ) 



v (x) 



^(^)<?o(£)^^> 9o (0= P{x,Ovo(x)*=*dx 
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It follows from the proof of Theorem 15 . II that go € C 



Let g (£) = j^go 
v (x) = 



, v{x) 



\x\ r - 



L ) and v € C°° (r"). 



then 



P(x,£)v(x)"- 2 dx. 



oo. 



Moreover for any R > 0, J* H n-i\ BR 5 (£) " d£ < oo and J K „-i 5 (£) " cfe; 
For A > 0, we define Hx,gx as in the Case 16. ll of the proof of Theorem 16. li but let 
B\ = {£ e H x \ {0} : g x (£) > g (£)}. Put the number in the proof of Theorem O 

_ n+2 



' = n^f ' then the same argument shows 



3a 



n-2 

3"+ 2 



2(r»-l)(n + 2) 



<c(n) Igl"^, 



(2Aei-JBj 



9x 



n-2 

3™+ 2 



2(n-l)(r» + 2) 



Note that for t; € B^, gx{Q > g (Q, hence 



2(n-l) 

ff (0 - de< 



2(n-l) 

9x (0 " 



When A is large enough, it implies 



■9a 



-2 
+2 



n-2 

3"+ 2 



2(n-l)(n + 2) 
£ n ( n-2J ( B .) 



< 



and hence 



9x 



n-2 



2(n-l)(n + 2) 
L »("-2) ( B ») 



<?A~ 



0, B? 



2(n-l) 

<? (0 » d£ < oo. 



2(i-l)(n + 2) 



Let 



A = inf {A > : B{, = for all A' > A} . 



We claim Ao = 0. Indeed if this is not the case, then Ao > 0. We may argue as 
in the Case 16. ll of the proof of Theorem 16.11 and get gx =9- In particular, this 

2(n-l) 

would imply J Rn -i 9 (£) " d£ < oo, a contradiction. It follows that Ao = and 
— 9(~ CiiC") f° r £i < 0- Since we may perform this process along any 
direction, we see g must be radial symmetric with respect to 0. Hence go must be 
radial symmetric with respect to 0. For any £ € R™ , we may apply the argument 
to go (■ + C) an( i deduce that go is also radial symmetric with respect to £, hence 
go must be a constant function, so is /. But this contradicts with the fact that / 
satisfies the equation. □ 
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